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Operation Whole Sumbers (OWN) , a cooputer assisted 
instructional approach to the four arithmetic operations (additiDn, 
subtraction^ multiplication^ and division), was used in nine 
elementary schools from January 1975 through June 1976. This report 
contains a brief description of the 0W» program, a discussion of the 
work required to implement the program beyond the single-school pilot 
phase, and an evaluation of the effect of the program in the nir? 
schools. The evaluation of the OWN program was conducted by comparing 
the performance of students from the nine schools using the OWN 
program to performance of students from four schools using a 
traditional approach. All students were given a pretest --nd posttest 
developed specifically for this investigation. The test results 
shoved that in each grade (3-6), stude^ats using the 3WH program 
significantly greater improvements tha?. did students in the^ 
traditional approach. Benefits of the program were substantial for 
third and fourth grade OWS studeats who had scored below average on 
the pretest; these students averaged from 3.6 to 2 months gain. 
When teachers* attitudes toward the OW* program were examined using a 
Likert-type questionnaire, 671 of the teachers expressed a favorable 
overall opinion of the OWN program and 901C responded that their 
students enjoyed working with the program. (DT) 
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ABSTRACT 



Operation ^Whole Nudbers (OWN>-+s-a- coinputer-assisted instruction aoproacb to the 
four arithrctic operations (+, X, The main CAI techniques employed in the 

OWN program are diagnostic testing, drill, and practice. These techniques , and 
others, are used as each student progresses through a controlled sequence of 
objectives ^"n each operation on a computer terminal- As students complete seg- 
ments of the CWN program, e.g., a drill, they receive "scoreboards" on the 
computer tecminal. The scoreboards are records of individual perforn:ance which 
students copy on individual permanent record cards. The teacher uses the rec- 
ord cards to: monitor student progress and identify individual student needs. 

A considerable amount of time, effort, and planning was required to implement 
the (Mil program in twelve elementary schools: teachers and students needed a 
formal orientation to the system, teachers' manuals and other materials had to 
be developed for the orientation and for the regular classroom implementation, 
equipment; had to be installed in each school, and the OWN program had to be 
translated into a different computer language. These activities were con- 
ducted in'the^summer and fall of 1974 and the spring of 1975. 

An evaluation of the OWN program was conducted in order to determine its 
relative effectiveness in the context of a large scale implementation. The 
major areas ofi.int^st in this evaluation were to compare CAI to traditional 
instruction and to examine teacher attitudes toward the program. In comparing 
"CAI to fr^ instruction, it ^as of particular interest to examine the 

effect of CAI on students with below average skills in arithmetic. 
> 

Selection of eTerientary schools to use CAI and to participate in the evalua^ 
tion of OWM in lii/b-76 was based on the number of fifth grade students in a 
school who had performed one or more years below grade level in mathematics 
as measured by the Problem Solving subtest of the Iowa Test of Basic Skills. 
The sixteen elementary schools with the largest number of these students 
were identified, twelve were selected as CAI schools, and four were to serve 
as comparison (control) schools for the evaluation. Although the CAI imple-- 
mentation began with tjvelve schools, three were eliminated because of budget 
constraints. Therefore, the evaluation was conducted in thirteen schools 
(nine CAI and four control) and involved students in grades 3 through 6. 
Students were given a pretest in mid-December, 1974, and a posttest '»n late 
May, 1976. Th^ tests used for the evaluation were developed specifically 
for this purpose; they were pi lot- tested in a school not in the study and 
appropriate revisions were made. 

The test results show that CAI students in each grade {3,4,5 and 6) made 
statistically significant greater improvements than did the students in the 
control schools. In different grades, CAI students averaged from 1-1 to 3.6 
months greater gain in mathematics achievement than the control students over 
fourteen months of school. Furthermore, the test results show that the 
benefits of the program were substantial for third ano fourth grade CAI 
Students who had scored below average on the pretest; these students 



averagecl from 3.5 zo 4.2 months gain. ^ ^ 

The opinion of teachers using CAI were very positive toward all aspects of the 
OWN program (over 82 per cent of the teachers had positive attitudes for each 
aspect of the program studies). These opinions were reflected in such areas 
as using the program to help individualize instruction, using diagnostic in- 
formation from the program, expressing a desire to continue using the program, 
and reflecting on student enjoyment of the program. 

In addition to the evaluation of student achievement, teachers' attitudes 
torard the CAI program were examined using a Likert type questionnaire. 
Eighty-seven percent of the teachers expressed a favorable overall opinion ^ 
of the program, an j 90 percent responded that their students enjoyed working 
with the CAI program. 



INTRODUCTION 



This is an evaluation of an MCPS computer-assisted instruction 
program called Operation Whole Nuriers (OWN). OWN is a computer- 
assisted instruction (CAI) approach to the four arithmetic operations 
(addition, subtraction, multiplication, and division) which was used 
In nine elementary schools from January, 1975, through June^ 1976. 
This report contains a brief description of the OWri program, the work 
which was required to implement the program beyond the single school 
pilot phase, and an evaluation of the effect of the* program in these 
nine schools. 



An extensive research and development effort preceded the implemen- 
tation of CAI ^nd is documented' in two MCPS reports. The first 
report. Computer Assisted-Instruction Project , covers the period 
July 1, 1969, through June 30, 1971, and the second report, Computer- 
Assisted Instruction Program , covers the period from July 1, 1971, 
to June 30, 1974. These reports discuss the history of CAI in the 
county and outline the research conducted during these periods 
which supported the implementation of the OWN program on a large 
scale. 



A. THE OWN PROGRAM 

OPERATION WHOLE NU^BERS (OWN) combines the CAI techniques of diagnostic testing, 
drill and practice in a program designed to strengthen a student's computational 
skills in each of the four basic operations on whole numbers. The program was 
designed for intermediate and 'upper elementary students but has also proved use- 
ful with students in special education, adult basic education, and tenth grade 
mathematics. 

At a cathode ray tube (CRT) computer terminal, the student progresses through 
/the program in a controlled sequence to attain the four terminal objectives: 

• / 

1* Given an addition problem with 3 three-place numeral^, presented 
vertically, *the student constructs the sum; regrouping from ones, 
tens, and hundreds, places is required. 

EXAMPLE: 986 
747 

2. Given a subtraction problem presented vertically, the student 
subtracts a four-place numeral from a four-place numeral; 
regrouping in hundreds, tens, and ones is required. 

EXAMPLE: 9,284 
■7,995 

3. Given a multiplication problem presented vertically, the student 
constructs the product when one factor is a three-place numeral 
and the otherjfactor is a two-place numeral but not a multiple of 
ten; regrouping is required. 

EXAMPLE: 763 
X 25 

4. Given a division problem with a four-place dividend and a two- 
place divisor not a multiple of ten, the student constructs 
the two-place quotient with or without remainder. Estimation 
does not always provide the correct answer. 

EXAMPLE: 83) 6742 

The content of OWN Is divided into four sections: addition, subtraction, 
multiplication, and division. Each section has three components: a pretest, 
a sequence of drills, and several review tests. A posttest on all four sections 
completes the program. 

A.l. Pretest 

A pretest consists of a survey test on the terminal objective of the program 
section and a network of diagnostic tests at specific drill levels to place the 
student at the appropriate level for computer-assisted drill or teacher instruc- 
tion. The addition and multiplication pretests aJso include basic fact tests. 

In all survey, diagnostic, and basic fact tests, the student receives an immedi- 
ate response to his answer. A correct answer will be reinforced with a comment 
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such as "Correct," "Good," "ExcelTent," or "Fabulous." The student who ansv;ers 
a survey or diagnostic problem incorrectly vn 11 be given a cornment such as ";iot 
•quite. Let's try another problem." or "Your answer is incorrect. Let's try 
a different prqblejn." The v/rong answer response in the basic fact tests is 
"Incorrect." 

^ For each pretest problem, the student is given a total predetermined time in 
which to type and enter the answer. If a student ta^ces too long to type and en- 
ter his answer, he is given a corrment such as "your ansv/er is correct, but/^ou 
have, taken too long to work the problem. Let's try another problem." or 'flou 
were too slow in answering. Let's try another problem." A problem whichn's' 
timed-out is scored wrong. 

If the student finds a survey or diagnostic test problem too difficult, he is 
allowed to type and enter an "X" as the .answer. An "X" is scored as a wrong 
answer. . 

Survey Test — addition, ^.ubtraction, and multiplication . To demonstrate 'pro- 
ficiency in the terminal objective of the operation and pass the survey test, the 
student must answer four problems correctly. A maximum of five problems' is pre- " 
'Sented. If the first survey test (addition) is passed, the student proceeds to 
the next survey test (subtraction). Hov/ever, as soon as he misses two problems 
in a survey test, he is branched to the basic fact tests in addition and mul- 
tiplication or tc the first diagnostic test in subtraction. 

Basic fact test — addition and multiplication . These tests include the 100 
basic facts in each operation grouped in four sections according to difficulty. 
Student performance determines which of two possible paths the student takes: 
through section 3 and 4 to the diagnostic network or through sections 3, 1, and 
2 to the drill sequence. Regardless of path, the student progresses through the 
section by studying and learning facts missed and by being retested until he 
achieves 100 per cent. 

Diagnostic test — addition, subtraction, and multiplication . To pass a diag- 
nostic test, the student must answer three problems correctly. A maximum of 
four problems is presented. If the student passes, the computer program will 
branch him to a diagnostic test of greater difficulty or to a drill at a higher 
level. If, however, the student answers only tv/o of the four problems correctly » 
he is put in a drill at that level. If he answers less than two problems cor- 
rectly, he is further diagnosed with problems of lesser difficulty or is branched 
to his teacher for instruction. 

Division pretest . In the division pretest, the student begins with a diagnostic 
test at level 13 in one-place divisors.' If he passes with three correct answers, 
he proceeds to diagnostic tests at levels 18 and 19. If he does not pass diagnos- 
tic 13 (or 18 or 19), he is further diagnosed and placed in the appropriate drill 
or branched to his teacher for instruction. 

The student who successfully completes the one-place divisors pretest proceeds 
to division Survey Test I, which contains problems from levels 28 and 29. If he 
passes Survey I witJi four correct answers, he is given Sufvey Test II with 
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problems from level 34, the terminal objective. Tne student who does' not pass 
Survey 1 is further diagnosed and placed in a drill. 

Before typing any quotient in the division diagnostic and survey tests, the 
student must select the place position for the first digit (i.e. hundreds, 
tens, or anes) of his answer. If the student selects the wrong place position, 
the problem ^is counted wrong. 

A.2. Drills 

In each section, a sequence of drills is designed so that each drill provides 
practice in a computational skill based on a specific mathematical concept. 
There are 25 drill levels in addition, Zl jn subtraction, 19 in multiplication, 
and 34 in division. The first 19 drills in division are one-place divisors; 
drills 20-34 have two-place divisors. At each of the 99 drill levels, there 
are 2 ten-problem drills: an original drill and an alternate drill. 

In- each drill problem, the student is given two attempts to type and enter the 
correct answer before the problem ts scored wrong. If his first answer is in- 
correct, the comment "No, try again." appears. If his second answer is incor- ■ 
rect, he is given the correct answer, is allowed time to compare his answer 
with the correct answer, and must type and enter the correct answer before the 
next problem is presented. 

Addition! subtraction, and multiplication drills . To pass a drill, the stud- 
ent must answer correctly nine or ten of the ten problems. When a student in 
an original drilj misses .tne first three problems or when his incorrect answers 
total five, he is immediately branched to his teacher for instruction. After 
instruction,' he reenters the original drill. When a student fails the original 
drill with a score of six, seven, or eight correct, he is given more practice 
with the alternate form of the drill. In the alternate drill, the student 
must complete all ten problems. If he answers correctly less than nine prob- 
lems, he is branched to hfs teacher for instruction. After instruction, he 
enters the original drill again. 

In each addition, subtraction, and multiplication drill problem, the student 
Is given a total predetermined time in which to type and enter the answer. A 
student who times out with a correct answer is told "Your answer is correct, 
but you need to work faster." and is given the next problem. The timed-out 
problem is scored wrong. A student who times out with a wrong answer is told 
"No, try again." and-is given the problem again. A second time-out on the 
problem scores the problem wrong. 

Division drills . All division drills contain a maximum of ten problems: To 
pass a drill* the student must answer correctly nine or ten out of ten or the 
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^ first* five problems. If he correctly answers the first five problems, he d6e,§ 
. not have to work all ten problems. Strategy for repeating a drill, branching* for 
* teacher instruction, and ansv/er evaluation are the same as in the other three 
-r- operations; However, in those division drills v/hich require the student fo work 
out oh the terminal each step involved in reaching the quotient (see below), 
each step is evaluated separately. Any two errors in a given problem (e. g., 
two- "No, try*" again 's") result in the problem's being scored wrong although the 
student must complete it to the quotient. 

If the student selects the wrong place position for the first digit of a quo- 
tient for a drill problem, he is given the correct place position. The computer 
records these errors in place position, but they are not counted as wrong ansv/ers. 
In division drills, the student receives a total predetermined time in which to 
complete the drill. Problems are not timed individually.. 

' ■ ( 

When the student is first branched into a division drill, he is required to watch 
the computer work a sample problem on the terminal screen. Then he must work out, 
with the computer on the terminal screen, each step involved in reaching the quo- 
tient for each drill problem. After successfully completing his first division 
- drill, the student is given a choice in each succeeding drill of working the 
problems out wi-th the computer oir working the problems on paper and typing and 
entering only the quotient. If he chooses to work the problems with the com- 
puter, he is given a choice of watching or not watching the computer work a sam- 
ple problem. However, if the student fails an original division drill, he must 
work out the problems of the alternate drill with the computer. 

A. 3. Review Tests ' ' 

In a review test, problems from the preceding drill sequence are randomly presented. 
There are 23 review tests placed at plateau points in the developmental sequence 
of skills throughout the program. Addition, subtraction, and division review 
tests contain 20 problems; the 6 multiplication review tests contain 10 problems. 
The student is given only one attempt to answer a problem correctly. For each 
answer, he is told "Correct" or "Incorrect." 

To pass a review test, the student must answer correctly 18, 1^, or 20 out of 
the 20 (or 9 or 10 out of 10) problems. If his score is -16 or 17 (or 8 out of 
10>, he is asked to try to correct the problems he missed. The computer recalls 
those 3 or 4 (or 2) problems and evaluates a second time for a passing score. 

If the student does not obtain a passing score after trying to correct the three 
or four: (or two) problems or if he misses more than four (or more than two out^ 
of ten) problems on his first time through a review test, he is branched to the 
lowest drill leyel from which he missed a problem. He repeats the drill(s) 
from which he missed problems, and then- he repeats the review test. If he fails 
the review test on his second attempt, he is branched for teacher instruction on 
the objective presented in the lowest drill level in that drill sequence. When 
he returns for work on the terminal, he enters the drill sequence at that level. 

11 
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• In the multiplicatfbn and division review tests, /problems are worked on 
paper and only final answers are typed and entered. If a student selects 
the wrong place position for the first digit of a quotient, the problem is 

. counted wrong. 

In each review test, the student receives, a total predetermined time in 
which to complete the entire test. If he times out on his first attempt, 
*he is branched to the lowest drill level from which he missed a problem; 
and he repeats all the drill from which he- missed problems. He then repeats 
the review tes>.- If he times out on his second attempt in the review test, 
he is branched for teacher instruction. After instruction, the student re- 
enters the drill sequence at the lowest level drill, repeating all the drills 
and then, the review^\test. 

A.4. Posttest 

At the end of the program, the s;tudent is presented a posttest which measures 
attainment of the terminal objectives. Twelve problems, three from each op- 
eration, are randomly presented. The student is given only one attempt to 
answer correctly. Wrong answers are Indicated with a comment such as "Your 
aaswer is incorrect. Let's try a different problem." The multiplication 
and division problems are worked on 'paper; only final answers are typed and 
entered. Selecting the wrong place position for the first digit of a quo- 
tient counts a$ a wrong answer. The student is given a total predetermined 
time in which to type and enter each answer. A time-out is' scored as a 
wrong answer. 

To this point, the description of the OWN program has been isolated to its 
internal structure. The rest of this section will describe how the program, 
as outlined above, functions in the classroom. 

Upon completion of a survey test, a drill (or an alternate drill), or a re- 
view test, a "scoreboard" isV'p resented on the screen of the computer terminal. 
A "scoreboard" is a representation of the student's performance and contains 
several elements: the student's name; a symbol indicating the level of. the 
program the student was working, the number of problems the student attempted, 
how many problems the student answered correctly, and a comment for the 
teacher. The student must take a moment to record the scoreboard information 
on his or her own personal record card. A record card is a peirmanent record 
of the student's progress ^through the OWN program. An example of a score- 
board and a record card are presented in Figures 1 and 2 respectively. 
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Tht stjdent record c«rd provides the teacher with a view of the student's current 
ptrfOfMnce ar^d a history of the sti^dent's progress to that point. Figure 2 is 
tilt front %ide of a record card, the reverse side contains the sane r;atrix format, 
ttltrtby illowing 36 entries on a single card- When a student is finished wr^rking 
Oil the computer terminal, th» record card is placed in a central location ;e.g-t 
a box on the teacher*$ deskj where cards for all the students are kept- The 
ttichtr then has quick and easy access to the performance of each student. 



In addition to providing an up-to*date record of student progress, the record 
card has the most current level atterrrpted by th^ student and a comrnent to the 
teacher concerning the studen t's work. The co?mnent is a note to the teacher 
indicating how the student perforrod and wnat action the teacher should take in 
light of this performance* 

There are several types of comnents a teacher ir-ay see on a record card: Pass, 
Practice* Help, Pract1ce*Tine. and Help-Time- The Pass comrnent indicates the 
strident has correctly answered a percentage df problems which reflects mastery 
of a skill; 90 per cent correct or better Is considered Biastery in the OUri 
program* A Practice consent is received when either 6, 7, or 8 problens are 
passed In a drill; a teacher knows from this corrient that the student .nil 
revive the alternate drill at the same level as a subsequent practice exercise- 
The teacher may decide to work with the student on the skill in which a Prac- 
tice ccmen?: was ^iven before the student atterots tne alternate drilK A 
Help comwnt Indicates the student is having difficulty; this type of coment 
is given If a student misses the first three profcleir^s in a drill, as soon as 
five problem are missed in a drill, or if a child misses two or more problems 
in an alternate drilK Obviously, at this point the student needs individualized 
instruction frm the teacher. The Practice-Tirrse and Help-Tirne comnents are 
presented ondN^r the sarne circuratances as the Practice and Help messages re- 
Ipectively; however, with these coutnents the problems wnich were missed in the 
drill were counted as wrong because the student used too wch time to work the 
pfoblen* 

The teacher's role in the OWn program is to introduce appropriate instruction 
whettever n^vtw^vf. As students progress through the levels of the OU*i croorarn, 
tha teacher can see fror, the student record cards which children require as- 
sistance and the specific skill in ^ich each child needs instruction. A 
Practice cortaent mignt oro^npt a teacher to provide additional problerns this 
tkill or allow tfte student to receive additicmal practice problerjs on the 
teminal. A Help cos^r^ent directs the teacher to provide Instruction for tne 
student at the appropriate leveK 

S. WiCKESTATm GF CW^ 

Tfwi OMi prograr? «ias origirally cilot tested in a*^€ elenentarv school ; a^d ex- 
pending fro^ one to ti^elve sc*^^ools recutred a ccr^siiiera^le arount of tir^, 
effort t p laming. Teacners and students needed to be oriente(1 to tre 
S/stef*, rjf^yjU a'-i^ ^ateriaU ^z^^'zt to te te^^^lrr^ed *cr c-^e^tat^c-- 
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the regular cl assroor. imlerentatirn , enuioront to le install^;d in t^^e 
schools* ^''^ ''"^'^ Dro']rcn nad to re tranr;lated into a diffor^--.^ ccr:-u^;'r 
language. These activities were conducted during the surrjner ard fall of 1974 
and the spring of 1375. 

B.U Orientation for Students and Teachers 

Prior to the ifr^plenentatlon of the CWr; program, students and teachers ^ere 
oriented to the prograr: und to the co :nuter eauiijr.ent . Students nceccd to learn 
how to operate an I3M 3277 cathode ray temlnal; and tc-achers needed :o l^im 
how the system was develo'v^d, how students wojld oroc-^ss througn tne curnculun, 
and how to Interpret feedback on student perf onnance. 

Teachers who began using the CAI systen in the spr.ng of 1975 participated in an 
orientation w^orkshop. The workshop ivas for three days which were about one 
month apart, spanning Septerrber to December, 1974. Teachers had an opc^ortunity 
to spend tiTO on a terrrinal as students, they learned now the OWN progran v-/as 
developed and how the levels of each operation . ^) huild in a loaical 

sequence toward the terriinal objective, and they learned about the kind of 
student infonration they would receive about student perfomance. In addition, 
practical aspects of using the systen were presented in the orientation se^- 
s1ons» including scheduling students for their cine on the terminal, v.eeoing 
records, and learning how to recognize and correct certain equipment mal- 
functions. The format of the orientation was condensed into a single day for 
teachers who began using the program in the fall of 1975. 

Everything pres-^nted to the teachers in the orientation was contained in a 
manual given to then to serve as a reference in the classroon. This was a 
loose-leaf noteDock w:th sections on all aspects of impletnenting the CAI pro- 
gram, including inforration as diverse as now to keep student records, 
scheduling students for the terminal, procedures to check the tcminal for 
wlfunctions (aid how to proceed 1f a malfunction occurs), a vocabulary li-rt 
of all words a student nunht encounter during the course of the O'JN oroc^rar;, 
and much more, nowever, the heart of the teachers* manual was the detailed 
description of the OWN progran which occupied about three*fourths of the 
«anual. This section provided a verbal description and a nuneric exa'^ole 
for each of the 99 levols of the OU"; course of study. So, if a student's 
record card indicated he needed help on "M12^' (nul tipl ication, level U) , 
the teacher could flip to tne nultiplication section of the manual, find 
H12» and Icai-^n precisely the type of skill the student needed to be taught. 
A page of the ranua^ is re::ro&jce<l m Figure 3, For illustration, the o^^ce 
selected contains Level '-HZ. Level Ml 2 is Cfea-^ly defined, and an oxar.-:^ 
is provided of tne type of iproole'^'* wfiKh '^^ets t^e reguirenents of thvs 
definition. 

The students in each class ;}articiDattn'5 ir the Droqran uere given an orit^^n-. 
tation ta the corp-^ter ?nd the rc^^^-ter terr:^n,a1. ^he student or- •^'^t ^ti c^^^ 
consisted of a lecture-sl vje Dres£=ntaticn to tr-^ cla-^s and an ori^j^tat^^::''^ for 
each child indlv^duallv ■r^'^ t*^^ or^ration oj' an i:** i:77 cathode ra/ l^^'-^r.%]., 
The lectur>-sn te ::ft: t.? : v:;'^ r-r^'^-o^i a:':::rc,»« itcU* 2"- nr-utt'S, s"-: 
individual or^e^tat^cn t.: t^'e cc-':;ut^*r t';^mra' n^^^'r^^d atout IS rnrutv. :^^r 
Student* ^ 

1 > 
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FIGURE 3 

A Page Fron The 
Teacher's :ianual 



Level 


Sample Problems 


Behavioral Objective 


Mil 


37 
X 8 


49 
X 5 


Given a multiplication problem presented ver- 
tically, the student constructs the predict, 
regrouping fron ones and tens, when one factor 
is a two-place numeral and the other factor 
is a one-place numeral. 


Ml ? 


154 
X 5 


167 
X 2 

« 


fiivpn h mul t id! i ration orobl^m ores^nt^d 
vertically, the student constructs the 
product, regroo'^ing fron ones and tens, when 
one factor is ^ three-p^ace numeral and the 
other factor is a one-place nume^^a^ 


Ml 3 


293 
X 6 


425 
X 7 


Given a multiplication problem presented 
vertically, the student constructs the 
product, regrouping fron ones* tens, and 
hundreds, when one factor is a throe-clace 
numeral and the other factor is a one-place 
nuneral . 



Following the student and teacher orientations, the OWN program became a regular part 
of tht classroom activities. There were different approaches to using the CAI system 
WOng the schools. For e.xarple, in sor^e schools the terrunals were located in a 
Mth lab; in other scnools the terminals were in the clasiroom. In either situation 
tht student/ terminal ratio was designed to provide each student an average of aporox- 
tMt«ly 20 to 30 minutes per week on t^e computer terminal. This time, 20 to 30 
•Inytes, allows a student to siw on the terminal, proceed thrcuch his or her ex- 
trclses, record the appropriate scoreboard tnformatlor on the record card, and 
$1gm off the terminal. 

S.2. Equiptncnt 

Th€ equipinent reauired for the oDeration of the OWN oroaran consists of several 
conponents: a catncde rav tube terrir.al w^ich Is located m t*>? classroom or 
In i inath lab. a modem and a control u-^^it located in the school office^ and t^e 
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computer at the cc*ucat1onal Services Center in Rockvine. The modens were from 
Bell Telephone, and the control units were ror^-^l IF*' 3271. The function of the 
noden and control units was to translate messages from the terminal to the com- 
puter and vice versa over telephone lines. The central computer with which the 
students were interacting was an IBM model 370/152. 

The OWN program was originally written in Coursewn'ter II* a prograrming language 
for instructional n^aterial. This language was inappropriate for the new system 
(IBM 370/1 58), and the OUN program had to be translated into a new language called 
Coursewriter III, This was a considerable task in terns of v/ork hours. In ad- 
dition to the translation, a complete debugging or the 0\Ui program in the new 
language t^s essential to ensure quality perfonnance of the program- 
ed RESEARCH 

An evaluation of the CAI-OIJN program was conducted in order to determine the 
relative effectiveness of the program in the context of a large scale implemen- 
tation* The primary component of this evaluation was student achievement, and 
there were three major questions of interest concerning this variable: 

1. Does the use of CAI result in an Increase in math achievement 
beyond what is achieved without CAI? 

2. If CAI is beneficial, is it differentially beneficial for students 
above average in achievement versus students below average in 
achievement? 

3. Do students below average in math perform better with CAI than 
without CAI? 

A second coifiponent of the evaluation was teacher attitudes toward the program. 
Althou^ specific qualitative questions were not raised cwcerning teacher at- 
titudes » measures were taken to provide information on teachers* perceptions 
of the program. 

C.l. Design of the Study 

This study was designed to evaluate the effect of the CAI OWN program on student 
skills in arithirjetic cofaputation. In order to do this, nine schools using the 
CAI program were co«q?ared to four schools not using the program. Grades 3» 4, 
St and I were used to compare CAI with non-CAI performance frc»n Decenoer, 1974^ 
through May^ 1976. Three parallel tests were developed and pilot tested to 
wasure student orogress- The>e tests were used for five test administrations 
Airing the course of the study. A pretext was administered in Decp'^fcer* 1974. 
. Tht second test, an end-of-year test^ was administered in June, 1975. The 
third test was given in SeptemOer^ 1975 as a beqinnina-of-the-school-yi»ar t^<;t. 
A Midyear test was acS-^inistered in Decerfcer. 197S; and the fifth test, a ocst- 
te$t» was conducted In Kay, 1976*- In addition to student achieverrent* teacher 
attitudes were wasured with a qi^stionnaire using a Likert scale in June, 1975, 
and In K^, 1976, to provide feedback from the teachrrs participating in tne 
studtf. 

17 
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C.l.a. Sample 

The Initial stage of the large scalo in^plenentation of CAI involved the selection 
of schools to use tne program. Studies conducted during the pilot project 
indicated that CAI was beneficial for students v/ith poor aritnnetic skills. . 
Based on this infonr.ation, the criteria for seler.ticn was the nurber 
of disadvantaged students in a school; and sc*iools v/ith the greatest nuiTiber of 
disadvantaged students were selected to participate in tne program. "Dis- 
advantaged*' was defined as performing at or below one standard deviation 
below the mean on the Problem-Solving subtest of the Iowa Test of Basic Skills 
(ITdS). The ITBS was the only test available which provided data on mathematics 
achievement in all elementary scnools in the county. 

A list was compiled ranking all elementary schools in Montgomery County on the 
basis of the nurtjer of disadvantaged students. Of the 16 schools with the greatest 
nwrter of disadvantaged students. 12 were selected to participate in the CAl 
program; and the remaining four schools served as control or non-CAI schools. 
Table 1 lists the schools in the study, the number of disadvantaged students in 
each schooU and the treatment they received. 

TABLE 1 

Schools Participating in the Study 



Rank in Number of 



MCPS 


Disadvantaged 


Treatment 


1 


100 


CAI 


2 


99 


Control 


3 


77 


CAI 


4 


70 


CAI 


5 


63 




6 


68 


CAI 


7 


66 


# 


8 


64 


Control 


9 


58 


CAI 


10 


57 


Control 


11 


55 


CAI 


12 


54 


CAI 


13 


53 


Control 


14 


52 


* 


15 


51 


CAI 


16 


48 


CAI 



♦Indicates schools which were eliminated frcMn the 
CAI program--see text ' 

Three of the 12 schools originally selected to use the CAI program were eliminated 
froia the study • Although 12 schools were planmed to use the system, budqet con- 
straints required thit sor^e scnools b-e eliminated for the 1975-1976 acadenic 
yeirt leaving 9 CAI schools and 4 control schools in the study. The schools 
ellmifiated frxm the study are indicated with an asterisks in Table 1. 
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Third, fourth, fifth, and sixth grade students were involved in the study. All 
third through sixth grade classes in each control school were used; however, 
this was not the case in CAI schools because of the availability of computer 
equipment. Four computer terminals were available in each CAI school to accom- 
moctate eight classes. (A few schools received additional terminals m January, 
1976.) Four terminals could accomodate eight classes and still maintain the 
desir«d rate of 20 to 30 minutes per student per week as discussed earlier. 
Given that only eight classes could use the terminals, they were deployed- differ- 
ently in different schools; some schools used the program in third and fourth 
grades, some in fourth and fifth grades, some in fifth and sixth grades, and 
others in combination of three grade levels. 

The student was used as the unit of analysis because of the impossibility of 
using the classroom as the unit of analysis. It is often desirable to use the 
classroom as the unit of analysis (with student nested within classroom) to 
eliminate the confoundina of treatment and classroom effects or the confounding 
of treatment and teacher effects. However, a nested analysis was not used for 
several reasons. First, the study continued through two academic years; there- 
fore students were regrouped from one year to the next to form new class units- 
In addition, as these new and different units are formed, they have nev; teachers. ^ 
The changes in class composition and teachers across academic years make it im- 
possible to isolate nested groups. Second, a variety of approaches to instruc- 
tion in mathematics was used in the CAI and control schools. Some schools had 
self-contained classrooms, some schools used math labs, and other schools re- 
grouped students within and across grades by achievement level for math instruc- 
tion. With some students going to math labs, some students going to different 
teachers for instruction, and some students staying in their own room, isolating 
nested groups became an Intractable problem; and a nested design was not feasible. 

Using the student as the unit of analysis, the sample size for each grade level 
1$ indicated in Table 2. These figures are based on the number of students with 
pretest (12/74) and posttest (5/76) scores. Therefore, the number of students 
used in the analysis is less than the number of students in the schools during 
the course of the study. Mortality, or' loss of subjects, may have occurred for 
a number of reasons; students may have moved, they may have been absent for the 
pretest or the posttest, or they may have had an invalid test (there were three 
pages to each test, and «^me studants skipped the second page). 



TABLE 2 

Number of Students Used in the 
Analysis for Each Grade 







Grade 









Treatment 


3 


3/4 


4/5 


5/6 




CAI 


146 


159 


408 


515 




Control 


180 


159 


154 


179 




ToUl 


19 


318 


562 


694 
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The grade notation used in Table 2 is continued throughout the report, and a 
brief explanation is in order. Grades "3/4," "4/5," and "5/6" are used to indicate 
that students started In the CAI program in one grade in the spring of 1975 and 
continued in the program in the next grade for ttie 1975-1975 academic year. The 
students designated as grade "3" were only in the program for the 1975-1976 
academic year. 

C.l.b. Instrumentation 

The dependent variable of interest was mathematics achievement which can be more 
specifically described as arithmetic computation (addition, subtraction, multipli- 
cation, division) with whole numbers. Different tests were developed for grades 
3> 4, and 5. The sixth grade test was identical to the fifth grade test because 
the most advanced skills covered in the OWN program are ordinarily presented by 
the end of fifth grade. All tests contained four sections, one for each arithmetic 
operation; however, the number of problems in each section and the difficulty of 
the problems differed across grades. The number of problems in each section of 
the three tests is presented in Table 3. 

TABLE 3 

Dispersion of Problems 
On the Different Tests 



Test 
Section 




Grade 




3 


4 


5/6 


Addition 


11 


7 


4 


Subtraction 


9 


7 


5 


Multiplication 


5 


9 


9 


Division 


JL 


J2 


H 


Total Problems 


31 


35 


33 



The precise specification of skills in the OWN program was ideal for the develop- 
vient of tests. The problems in each section of a test were chosen from levels 
of the OWN program in order to reflect the entire range of skills which are 
covered. The last problem in each section was the terminal objective for that 
operation. That is, the most difficult skills covered by the OWN program are 
Included as the most difficult problems on the test. The only exception to this 
Wis for the multiplication and division sections of the third grade test where 
the last problems were levels M13 and DIO, respectively* and the terminal' object- 
ives arc M19 and 035, respectively. The problems on the tests were grouped by 
operation; aid within each operation, the problems were arranged in ascendim^ 
order by difficulty* The student was required to construct the answer to eacn 
problem (it was not nultiple choice), and one point was given for each prcolen 
answered correctly* 
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The first form of the test for each grade was pilot tested at an elementary 
school not in the study. There were two classes available at each grade (3, 4, 
5, and 6) for the pilot testing. The testing was conducted to evaluate the range 
of difficulty of the items, to detect problems in tfie administration procedures, 
and to see if 40 minutes was an adequate time allotment for students to complete 
the test (the test was intended to be nonspeeded). The items in the tests were 
satisfactory, minor revisions were made in the administratioh procedures, and the 
time limit was found to be adequate* 

The test administrations of December, 1974, and December, 1975, were used to 
estimate the reliabil ity of the tests. A nonrandcm sample of tests were drawn 
fron each grade in CAI and control schools. Reliability was estimated by using 
coefficient alpha ^ which was computed by using a Fortran IV program written by 
the author. The reliability estimates are presented in Table 4. 

TABLE 4 

Estimates of Test Reliability 
For Each Grade 





Reliability 


Grade 


12/74 (n) 


12/75 (n) 


3 


.87 (119) 


• .89 (104) 


4 


.91 (79) 


.90 (132) 


5/6 


.91 (108) 


.92 (105) 



The precise specifications of skills in the OWN program made the development of 
parallel forms of the tests straightforward. Three parallel fonns were developed, 
and every item in each form had a parallel item in all other forms. The items 
were parallel in that they came^ from a specified level of the OWN program. There- 
fore* the seventh problem in the addition section of the third grade test was from 
level A18 (addition level 18); and all parallel forms of the third grade test have 
i problem from^evel A18 as the seventh problem in the addition section. 

C.l.c. Data Collection 

There were five test administrations in all, including the pretest and posttest 
which are the basis of the data used in this evaluation. Several weeks before 
testing^, the schools were contacted by phone to ensure that the tentatively selec- 
ted test date was satisfactory. If there was a conflict (i.e., field trip, school 
playt or other activities which would disrupt a testing environment), a testing 
date could be BX)ved up or back a day or two. Once the test dates were established 
for each school , wemor an da were forwarded to principles and teachers involved 
In the testing. The memo indicated the test date, the time of testing, and 
general testing procedures. Attached to the memo was a set of instructions 



1 Coefficient alpha {cil is an index of the reliability of a test which 
My be used with a single administration of a test. 



for the teacher, part of which were read to the class. These attached instructions 
were complete, from handing out the tests through picking up the tests; when the 
test administration was completed. 

All classes in a school were tested on the same day. A CAI teacher specialist 
distributed a packet of tests to each classroom teacher at the start of school. 
The CAI teacher specialist remained in the school as a monitor during the test 
administration to provide assistance, if needed, or to provide extra copies of 
tests or instructions in case of a shortage. Teachers were allowed to begin the 
testing at their convenience any time before 10:00 a.m. After a class had com- 
pleted the test, they were placed in the packet and returned to the CAI teacher 
specialist. There was one deviation from the single-day test administration in 
the 13 schools In the study. One school administered the tests in the school's 
math lab during each student's scheduled math lab period. In order to test all 
students In this manner, one full week was required to complete the test adminis- 
tration in this school. 

There were five test administrations using three parallel forms of the tests for 
third, fourth, and fifth/sixth grades. Table 5 indicates test dates for the 
five administrations and the form of the test used in each. 

TABLE 5 



Test Dates and Forms 





Administration 


Date 


Form 


1 


12/74 


I 


2 


6/75 


II 


3 


9/75 


III 


4 


12/75 


I 


5 


5/76 


II 



Re!>uUs 



The purpose of this study was to evaluate the achievement of student?^ in schools 
using CAI where the achievement variable of interest is in arithmetic computation 
of whole numbers. The results presented below are directed toward answering 
several specific questions: 

^ 1. Does the use of CAI result in an increase in math 
\ achievement beyond what is achieved without CAI? 

2. If CAI Is beneficial, is it differentially beneficial 
for students above average in achievement versus 
students below average in achievement? 

3, Do students below average in math perform better with 
CAI than without CAU 
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These questions are not directly answerable as stated; each one must be studied 
at each grade level. In addition, as with ail data in behavorial sciences, there 
is more than one way to approach the answer to each question; therefore, tv/o ap- 
proaches will be used here. The first approach will be the usual analysis of 
variance, which will provide statistical information about the differences which 
are observed between students who use the CAI program and those who do not use 
the CAI program. Statistically significant differences provide only limited 
information for decision making. For this reason, a second approach will be 
used to evaluate the program if significant differences are found. The second 
approach is a quantification of differences which expresses test performance 
in months, as opposed to points, thereby allowing a conceptualization of the 
magnitude of any statistically significant differences observed in the data. 

In addition to examining student achievement, teachers' responses to question- 
anires given in June, 1975, and May, 1976, are discussed. The questionnaires 
were designed to provide information about teachers' perceptions of the CAI 
program- 

C.2.a. Question 1. Does the use of CAI result in an increase in math 

achievement beyond what is achieved without CAI? 

This question was answered by examining pretest and posttest scores between 
students in the CAI schools and students in the control schools, and it was 
answered affirmatively in each grade. Table 6 provides data on pretest 
(12/74) and posttest (5/76) performance for CAI and control students as well 
as data from the three intermediate test administrations. Analysis uf 
Covariance (ANCOVA) was used to examine pretest and posttest performance 
for the existence of statistically significant differences; these results 
are presented in Table 7. Posttest performance was significantly different 
(p < .05) for each grade in favor of the CAI program. 

A second approach can be used to study the observed difference in achieve- 
ment betiyeen CAI and control schools. Beyond the claim that the differences 
are statistically significant, a useful interpretation can be achieved fay 
translating the observed test point gains into months of gain. There are 
several ways this can be accomplished. 
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TABLE 6 

• Means and Standard Deviation for CAI and Control Schools 







12/74 


6/75 


9/75 


12/75 


5/76 


Gain 


Grade 


3/4 CAI Mean 


13.612 


19.973 


14.507 


17.015 


23.478 


9.866 




S. D. 


4.770 


6.087 


5.679 


5.789 


7.079 






Control Mean 


13.255 


19.191 


14.055 


17.426 


21.752 


8.497 




S. D. 


4.862 


6.145 


5.813 


7.305 


7.955 




Grade 


4/5 CAI Mean 


16.362 


22.563 


18.208 


21.260 


24.590 


8^228 




S. D. 


7.630 


8.176 


8.489 


8.003 


6.969 






Control Mean 


15.740 


20.400 


15.789 


19.9701 


23.367 


7.627 




S. D. 


5.585 


6.888 


6.668 


7.388 


6.433 




Grade 5/6 CAI Mean 


17.905 


22.647 


21.887 


24.421 


27.126 


9.221 




S. D. 


7.597 


7.428 


7.697 


7.212 


6.289 






Control Mean 


20.561 


22.392 


23.232 


26.179 


27.750 


7.189 




S. D. 


7.144 


7.219 


6.841 


5.428 


5.362 




Grade 


3 CAI Mean 


* 


* 


11.507 


* 


22.582 


11.075 




S. D. 






4.878 




6.441 






Coatrol Mean 


* 


* 


10.352 


* 


19.094 


8.742 




S. D. 






3.547 




5.713 





f 

* test not administered - see text 



24 

ERIC \ 



TABLE 7 

ANCOi/A Tables for Posttest with Pretest as Co van ate 





Source 


df 


SS 


MS 


F 


Grade 3/4 (12/74 - 5/76) 










Covariate 


1 


• 7,640.539 


7,460.539 




• Treatment 


1 


174.285 


174.289 


5.16* 


Residual 


315 


10,639.781 


33.777 




Total 


317 


18,274.609 


57.649 




Grade 4/5 (12-74 - 5/76) 










Covariate 


1 


13,643.977 


13,643.977 




Treatment 


1 


87.762 


87.762 


3.897* 


Residual 


559 


12,590.871 


22.524 




Total 


561 


26.322.609 


46.921 




Grade 5/6 (12/74 - 5/76) 










Covari ate 




11,388.914 


11,388.914 




Treatment 




87.309 


87.3U9 


4.306* 


Residual 


691 


14,009.001 


20.274 






693 


25.485.230 


36.775 




Grade 3 (9/75 - 5/76) 










Covari ate 




3,254.939 


3,254.939 




Ti:;«atnient 




649.310 


649.;31P-. 


23.478* 


Residual 


323 


8,932.855 


27.656 




Total 


325 


12,838.105 


39.499 




'* (p<.05) 




i 
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The approach chosen was. to define the control school 
that during the 14 months of the study the performan 
represents 14 months of achievement. Based on this 
point was calculated for the control-^schooTs , where 
posttest minus pretest differences. This ratio was 
difference between pretest and posttest performance 
process^ had to be' performed separately in each grade 
fourth grades, the control students gained 8.497 poi 
or 1.648 months per point. The CAI students gained 
same period; or ajssuming'that one point represents 1 
16.259 months during the same 14 months of school, 
vided for each grade in Table 8. 



s as a .standard and assumv'^ 
ce of the control students 
assumption, the ratio months/ 
points are calculated as 
then multiplied by the 
in the CAI schools. This 
; for example, in the third/ 
nts in 14 months of school 
9.866 points during the 
.648 months, they gained 
This type of data is pro- 



TABLE 8 . ' • • ' 

Performance of CAI and Contror'students 
Using Control Students as a standard 



Months Gain 



Grade 


Control 


CAI 


3 


10 


>2.669 


3/4 


14 


16.259 


4/5 


-, 14 


15.103 


5/6 


14 


17.597 



Z.Z.b. Question 2. 



If CAI is beneficial, is it differentially beneficial 
for students above average in achievement versus 
students below average in achievement? 



Although the first question was answered affirmatively, this could occur if 
CAI was beneficial for only a subgroup of the students in the study. It may 
be that CAI is effective for all students, only students with less than average 
skills, or only students with above -average skills. The second question addresses 
this possibility: In order to perform this type of analysis, the overall mean on 
the pretest for CAI and control- students was used to make a dichotomy of upper 
and lower^groups in each grade. .For each grade, there are four groups; CAI above 
average, CAI below average, control above averige, and control below average. • 
Resultsxof the performance in these subgroups is given in Table 9. 
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TABLE 5 

Analysis by Above and Belov l!ean Dichoconry 



Grade 3/4 



Above Mean Pretest Posttest Gain 

CAI 16.7C9 26.S19 10.110 

Control 16.466 26.443 9.977 

Below Mean 

CAI 9.603 ^■^■19.724 . 10.121 

Control 9.155 15.944 6.789 

Grade 4/5 [ 

^>ove Mean * " 

CaT" 22.148 / 28.626 6.478 

Control 20.992 ' 27.013" , 6-021 

Below Mean 

CAI 9.661 20.089 10.423 

^.^-^ Control 10.558 » 19.553 8.995 

.. . • 

Cra4 5/6 # f 

Above Mean \ 

- c^ 24.006 30.611 6.605 

Control 24.610 29.588 4.978 

Belo w Mean 

CaF 11.518 23.758 ^,,12.240 

Control 12.235 24^6* • 11-929 

Grade 3 

Above Mean — 

CAI~ 15-216 25.1«9 9.973 

CoQCrol .13.970 22.4^.3 - 8.478 

Bel ow Mean 

CaT" 7.694 19.903 12.209 

Control 8.239 17.106 8.867 
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The results fron this breakdown of the data are not consistent across grades. _ 
Students in upper and la.;er grcuos in D^.I schools cutoerforr. tne control scr.cois 
at eadJ grade level. However, neitner tioper nor leer grouos are consistently 
favored across grades. The below average stucents apoear to Dsneftt nore in 
lower grades, whereas the above average students appear to benefit more in the 
upper grades. 

There are two prcffllems encountered in the interpretation of this inforr.ation._ 
First, the grade by level interaction cannot be tested for significance. Dit- 
ferent tests wer^ used in different grades, therefore the variables have oeen 
aeaiured in such a way as to prohibit statistical analysis of this interaction 
Second, the interpretation of this type of interaction would be speculative. If 
CAI were consistently better for one group of students across grades, the inter- 
pretation- would be straightforward. However, this is not the case, and interpre- 
ting the --interaction of grades with levels is not straightforward. 



C.2.C. Question 3. 



Do students belov/ average in nath perform better 
with CAI then without CAI? 



This question is logically contained within the preceding question. However, 
It is of interest to address tnis question specifically and separately because 
it was believed that CAI was beneficial for students achieving below average in 
arithmetic. Evidence of this nature was seen in studies conducted during the 
pilot phase of the CM'A progran. 

Lilte the preceding questions, this question ^^ust be examined at each grade level. 
Differences in gain from pretest to posttest are given in Table 10 by grade tor 
all students scoring belcw the overall .'nean on the pretest. Because this qu"- 
tion is actually part of Question 2, it is not surprising that che data does 
provide a str*ghtforxard interpretation here as well. By exanining 
performance within each grade, it is found that students below average 
nent are helped ncre in the- lower grades (3,4) by CAI and that CAI is 1 
beneficial, if at all. for tiiese stucents in tne upper grades (5.6;. 
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Performance of Students below Average 
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Gain 


i 

Difference 


Grade 


Treatment 


- (Posttest-Pretestj 


(CAI-Control) 


3 


CAI 


12.209 


3.324 




Control 


8.867 


3.132 


3/4 


CAI 


10.121 


Control 


6.989 


1.433 


4/5 


CAI 


10.428 




Control 


8.995 


0.311 


5/6* 


fAl 


12.240 




Cont/oi— 


11.929 
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The differences presenied in Tab^e 10 can t)e better understood by noting that at 
' a cfniciLKn one test point indicates at least one rontn's gain in achleverent. J^^ere- 
fore, the gains in the earlier grades are substantial. In addition, all tne dif- 
ferences are statistically sicnificant (p<.05}, except in grade 5/6. 

C.2.d. Teacher Attitudes 

Likert attitude questionnaires were distributed in June^ 1975, and in May, 1976, 
to teachers using the CA! progran. These two instruments were given a year apart 
to see if teacners' attitudes cnanged after using the CAI system for an extended 
period of time. Tnis was important because tne initial novelty of the progran 
could produce biased attitudes at the beginning of the progran, whereas attitudes 
would stabalize after a longer period of using the program. 3y June, 1975, teacners 
had used CAI for about four nonths; and the first r^asurernent of teachers' attitudes 
would reject inUial impressions. 3y r!ay, 1976, teachers had used the system for 
about 14 months; and the second rneasurerent reflects a icore stable opinion. 

As it turned out, the results of the two adninistrations of the attitude question- 
naires were highly consistent. T^^ere were ten items cornr.cn to both ins trunients , 
and the aggregate response of teacners to these items did not change markedly for 
any of these iteirs. The results of the iters which reflect teacher perceptions of 
the system are discussed in the paragraph '^ich follov%*s. The percentage figures 
reflect the ccrrtiined results of the two adninistrations of the attitude inventory 
except where otherwise specified. For most of the items, the results of both ad- 
ministrations were so similar that a distinction between the results of the June, 

1975, and the May, 1975, data is trivial. Therefore, unless otherwise indicated, 
the data reflects a cornbination of the two iDeasurements for 80 teachers. 

Wfien asked if the CAI prograin was a usefuil resource, 89 per cent of the teachers 
Indicated that it was useful, 3 per cent f^lt it was not a useful resource, and a 
per cent either marked neutral or did not respond to this item* One of the major 
functions of the ^AH program is to diagnose areas in which individual students are 
having difficulty; S3 per cent of the teachers indicated that the diagnostic in- 
formation they received was useful, 5 per cent did not fepl this infomation was 
useful* and 7 per cent marked neutral or did not respond. The purpose of pro- 
viding individual diagnostic information is to allow the teacher to provide in- 
dividualized Instruction to students. In May, 1976, 82 per cent of the teachers 
felt that the CAI program enabled them to individualize their math Instruction; 
this is an increase from 68 per cent in June, 1975. By May, 1976, only 5 per 
cent of the teachers did not feel that CAI program enabled greater individualiza- 
tion. Eighty-seven per cent of the teacners indicated a favorable overall opinicn 
of the program, and S2 per cent expressed a desire to continue using the progran; 
3 per cent indicated a negative overall opinion of the program, and 9 per cent 
indicated that they would prefer not to use tne CAI progran. Finally, in May, 

1976, after using the program for 14 months, 90 per cent of the teachers felt 
that students enjoyed woricing on the computer terminal. This indicates that 
Students did not seem to lose interest in doing arithmetic on the computer ter- 
nlnal over an extended time period. 
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D. CONCLUSiaN 



It is evident from the answer to Question 1 that the OWN program enhances student 
achieveiaent in arithinetic cociputation. Exanination of the performance of all 
students in grades 3, 4, 5 and 6 show that OWN is beneficial in each grade from 
statistical and practical viewpoints. There was statistically significant im- 
provement in achievement of CAI students when compared with students in tra- 
ditional classroom settings. This inproveinent can be expressed in months gain 
to help clarify the nagnitude of the effect of CAI. Students in grades 3 through 
6 using the OVfN program for fourteen months averaged from 1-1 to 3.6 months 
• flreater gain in arithmetic achievement than students not using this program. 
Third grade students who used the program for one acadensic year, lo months, 
averaged approximately 2.7 months greater gain than control students. These 
findings establish the beneficial effects of the OWN program. 

In an examination of the effects of CAI on students with above and below average 
skills in arithmetic, the findings were not consistent in different grades. The 
OUN program is most helpful for students in grades 3 and 4 with below average 
skills in aritfunetic and for students in grades 5 and 6 with above average skills 
In arithmetic. However, the greatest benefit of the OWN program is for students 
in the middle elementary grades (3 and 4) with below average arithmetic skills; 
these students averaged from 3.6 to 4,2 rrvonths gain. 

The opinions of teachers using CAI were very positive toward all aspects of the 
OWN program (over 82 per cent of the teachers had pos>tive attitudes for each 
aspect of the program studied). These opinions were reflected in such areas as 
using the program to help individualize instruction, using diagnostic informa- 
tion from the program, expressing a desire to continue using the program, and 
reflecting on student enjoyment of the program. 
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